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In a vocational high school in Ottawa, Canada, with 
an enrollment of approximately 750 students, 25 different shop 
courses are available. Students must take six shop courses during the 
first year, then specialize in two during the second year. During the 
first 2 years of operation, between two-thirds and three-fourths of 
those enrolled requested changes in their program. In order to reduce 
the number of changes, this study sought to provide information, in 
the form of differential validities, derived from a suitable battery 
of tests, which would be useful in identifying those occupations most 
likely to offer rewarding careers to non-academic individuals. Three 
separate cohorts of students, each containing 350 students, were used 
in the study of a double cross-validation design containing four 
phases. It was concluded that differences in acadenic performance and 
performance in shop areas can be predicted with soire success for both 

sexes. (GEB) 



£ 



ERIC 




$ «• 



/ 



/ 



/ 



o* 

CO 
-4- 
K\ 
s O 



U S, DEPARTMENT OF HEALTH. 

EDUCATION ft WELFARE 
DFFICE OF EDUCATION 
THIS DOCUMENT HAS BEEN REPRD- 
DUCED EXACTLY AS RECEIVED FRDM 
THE PERSDN OR ORGANIZATION ORIG 
INATING IT POINTS OF VIEW OR OPIN- 
IONS STATED DO NOT NECESSARILY 
flEPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY 



DIFFERENTIAL VALIDITIES FOR SHOP COURSES 



Ui 



Paper presented at Annual Meeting 
of American Educational Research Association 
Chicago, April 1972 



( 



CO 

uo 

•H 

O 

H* 




Janice J. Lokan 
Gerald Halpem 

Research Centre, Ottawa Board of Education 
March, 1972 

l 



A 



DIFFERENTIAL VALIDITIES FOR SHOP COURSES 



This paper is an abbreviated account of an extensive study which has been 
described fully in several reports published by the Research Centre of the 
Ottawa Board of Education, Ottawa, Ontario, Canada. 

The reports are: 

Lokan, J. J., "Differential Validities for Shop Courses: Progress Report", 

Research Report 69-06 , June 1970. 

(Describes development and selection of aptitude measures included 
in predictor battery). 

Halpem, G. and Lokan, J. J., "Differential Validities for Shop Courses: 
Second Progress Report”, Research Report 69-07 , July 1970. 

(Describes development of instruments used to measure aspects of 
vocational interests and occupational preferences) . 

Lokan, J. J., "Differential Validities for Shop Courses: Final Report", 

Research Report 70-05 , April 1971. 

(Gives a brief overview of the study, and presents all results 
derived vith the validation sample) . 

Lokan, J. J., "Differential Validities for Shop Courses: An Explanation 

of Purposes find Results”, ReseMch_JteiBorandjfflj_j[1^03, October 1971. 

(Gives a brief discussion of the study, intended for lay readers). 

A further report, incorporating cross-validation results, is in preparation. 



Dr. Robert L. Linn, of the Educational Testing Service, acted as Statistical 
Consultant for the study. 

The study was funded by the Ontario Department of Education, and the Canada 
Department of Manpower and Immigration. 
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DIFFERENTIAL VALIDITIES FOR SHOP COURSES 
Introduction 

Researchers have now been grappling for more than half a century with 
the idea that a person's future performance, and perhaps also his future 
satisfaction, can be predicted on the basis of his present characteristics and 
behaviour • A vast number of studies with the aim of making such predictions 
has been conducted. Several statistical techniques have been suggested for 
handling the kinds of prediction and classification problems that are en- 
countered in educational and vocational guidance settings. Yet, to date, no 
great breakthrough in improving the accuracy of prediction in these settings 
has occurred. This state of affairs has led Goldman (1972) to express the 
view that test scores have little to offer in counselling. 

The school in which the study described in this paper was carried out, 
however, represents a case for the more optimistic view that test scores 
can provide information that is useful to counsellors and students alike. 

The school is a vocational high school where students who are thought to have 
minimal chances of success in any regular high school curriculum undergo a 
two— or four-year shop-oriented programme . Half of each day , however , is 
devoted to academic work at an appropriate level. Total enrolment at the 
school is usually about 750 students. Twenty-five shop courses are available; 
each student must take six in his or her first year, before specialising in 
two shops from among these six during his or her second year. Thus, assuming 
that it is desirable for the students' shop specialty training to be in the 
area in which they will later find work, crucial decisions concerning possible 
future occupations for them need to be made at the grade nine level. 
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In its first two years, the school operated without a general testing 
programme. During that time a large number of students, somewhere between 
two-thirds and three-quarters of those enrolled, requested changes (often 
more than one, and at more than one stage during the year) in the programmes 
of shop options that they had selected at the beginning of the year. The 
Guidance Department at the school felt that some of these changes arose 
because many of the students came from limited experiential backgrounds 
(most fathers were in semi-skilled or unskilled occupations, or were unem- 
ployed or non-existent; about 30% of the students came from families on 
welfare). The students probably knew very little about their own abilities 
beyond the fact that they had experienced constant failure at elementary 
school. Thus it seemed that a comprehensive series of tests, provided that 
they were at a suitable level of difficulty, could be of real assistance in 
placing the students in appropriate training courses. 

Aim of the study 

The over— all aim of the study was to provide information , in the form 
of differential validities derived from a suitable battery of tests , which 
would be useful in ident ifying those occupations most l ikely to offer 
rewarding careers to non-academic individuals . 

Following the suggestions of French (1955) and Horst (1957) that com- 
parative information is of particular use in guidance, stress was placed on 
the differential prediction of success in some types of training programmes 
rather than in others. It was felt that the range of courses offered at the 
school was broad enough to warrant attempts at differential prediction (this 
is discussed further in Section 2) . 
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1. Related Research 

Only a small number of validity studies employing techniques of differential 
prediction have so far been reported in the literature , though the techniques 
themselves have been under discussion for many years (e.g. Br ogden, 19A6; 
Mollenkopf, 1950; Thorndike, 1950; Horst, 1954). The main reason for this is 
probably the large number of problems associated with differential prediction, 
discussed by Wesman and Bennett (1951) , Kelleher (1969) , and Norris and 
Katz (1970). However, attempts to overcome these problems have increased in 
recent years, as the value of comparative prediction in guidance has become 
more widely recognized. 

As with most absolute prediction studies, the differential prediction 
studies reported have been concerned largely with college or potential college 
scudents. The predictor measures tried have ranged from the large, diversified 
set of 42 measures of aptitude, Interest and personality ”f actors" used by 
French (1961), to the limited set of scores in four areas of the ACT tests 
investigated by Cole (1969). Biographic information has also been included 
in some analyses (Lunneborg and Lutmeborg, 1966; Lunneborg, 1968). Differences 
between grades in several college major fields have been the criteria. By 
and large, differential correlations found in these studies have been low, 
not exceeding 0.40. Verbal - quantitative or Humanities - Science differences 
could, not surprisingly, be predicted best. None of the studies cited above 
reported results separately by sex. 

Two large-scale diffenrential prediction studies have been carried out 
with high school students (French, 1964; Norris and Katr, 1970). Students at 
all ability levels in the upper grades of high school were Included in both 
studies, but in the differential prediction of marks, attained at Grade 12 
or Grade 13 levels, only academic subject fields were considered as criteria. 
Shop grades were used for trade school students in French's study, but only for 
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absolute prediction. In both studies results were presented separately by sex. 

Again, the majority of the differential correlations found were less than .AO, 
though a few exceeded this value, and one or two in each study exceeded .50. 

A second strand of relevant research relates to the non-academic nature 
of the students who were the subjects of this study. In the last few years 
there has been a great deal of concern regarding possible middle-class culture 
bias in the verbal, academically-oriented, testing programmes currently in use. 

Much effort is being devoted to exploring methods of assessment which will not 
be discriminatory against disadvantaged groups. In most research articles 
the word "disadvantaged" has had ethnic connotations. However , any group 
of low-achlevimg non-academic students, for whom existing guidance batteries 
are unsuitable, warrants the development of appropriate assessment measures. 

The work of Freeberg (1969) with disadvantaged adolescents in New York City 
proved particularly valuable to the present study. 

2. Requirements for Successful Differential Prediction 

Differential prediction is the prediction of differences between perfor- 
mance on pairs of criteria. The most cononly used method for calculating 
differential correlation coefficients is due to Mollenkopf (1950) , who 
derived the following formula relating predicted and actual differences: 

Insert from p. 1 of Appendix here 

It can be seen from this equation that the multiple R’s for the absolute 

prediction of the two criteria should be high. Likewise, the correlation 

between prediction., r a . b *, ehonld be low. "It 1. thu. the goal of differential 

prediction to get good predictions of each of the criteria, predictions which 

are at the same time as Independent of each other as possible" (Lunneborg, 1968, p298) 
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Since the quantities r a * b * and r flb tend to be closely related (Norris and 

Katz, 1970), it follows that the correlation between actual criterion scores, 

r ab , should not be too high. This is in agreement with the common sense idea 

that if criterion variables are highly related, the real differences between 

them will be small, and difficult to predict. In differential prediction the 

proportion of variation in the predictors and criteria which is unique becomes 

Important. The chief reason why most differential prediction results have 

the criteria, 

so far been fairly low is thought to be that, in the academic areas studied, 
and also many of the predictors, share too much common variance (Cole, 1969). 

In the present study it was hoped that the diversity of shop courses 
offered, and the planned inclusion in the predictor battery of several types 
of tests, would provide favourable circumstances for differential prediction. 

3. The Study 

Design, Methods and Data Collection 

To achieve the over-all objective, the study was planned to be longitu- 
dinal. In addition to the usual validation fnd cross-validation procedures, a 
"pilot" stage was necessary so that tests suitable for the non-academic 
population in question could be identified or developed. Altogether three 
separate cohorts of students, comprising all first “year students entering 
the school in three successive years, were involved in the study. Each cohort 
contained about 350 students, of whom about two-thirds were boys. 

For the double cross-validation design selected (Mosier, 1951), four main 
phases 1 were delineated: 

I: (1968): Pre-testing and selection of predcitor battery- 

Cohort 1. 

1 A fifth phase , in which the validation sample is being followed through its 
first year of work experiences, is currently in progress, but does not 
form part of this report. 
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II: Sept. 1969 to 

Aug. 1970: 



III: Sept. 1970 to 

July 1971: 



Validation (or "derivation”) phase - Cohort 2 
(hereafter referred to as "validation sample" 
(VS) or "Sample 1"). 

Cross-validation phase - Cohort 3 (hereafter 
referred to as "cross-validation sample" (CVS) 
or "Sample 2"). 



IV: Aug. to Oct. 1971: 



Double cross-validation phase, Samples 1 & 2. 
Details of the composition of Samples 1 and 2 are shown in Figure 1. 

Figure 1 about here 

Fhase__l. Where possible it was initially intended to use existing instruments 
as predictors. Many published tests were each administered to subgroups of 
about 40 student^ who had been selected by sampling methods to ensure repre- 
sentativeness. It soon became apparent that, because of the nature of the 
student population involved, several tests would have to be constructed for 
the study. The nature of the population can perhaps be understood from an 
examination of Figure 2, which shows the distribution by reading grade level 
of both the VS and CVS. A requirement for admission to the school is that 



the student must be 15 years of age, yet the average reading grade level is 
about 5.7. The mean IQ (non-verbal) of both samples was about 86. Published 

Figure 2 about here 

te^ts for average students of their age group would have yielded very restricted 
ranges of scores, scores which would in most instances not be valid anyway 
because the students would not have been able to read the test items. Some 
tests for lower age groups were also tried, but were usually found to be too 
difficult or too long. (Most of the students come to the school with poor 
motivation for test-taking, and are characterized by short attention spans). 

The selected predictor battery included measures covering scholastic, verbal, 
mathematical, clerical and mechanical aptitude, eye-hand co-ordination, general 
motor ability, vocational interests and occupational preferences. A list of the 
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tests included is shown in Table 1. Specially constructed tests are indicated 
in this table, and some reliability indices are provided. Published tests 
which were tried but not selected for the battery are shown in Table 2. 

Tables 1 and 2 about here 



The suitability of the new and modified tests in terms of a) appropriate 
difficulty level and b) potential for use in prediction was assessed in part 
by considering the distributions of scores* In addi tion ,itetn analyses were 
carried out in Phase II on the two Mathematics tests and the Filing test. 

A brief description of the non-published predictor tests is Included here. 
Further details are given in the Research Reports cited at the beginning of 
this paper. 

1. Highland Park Mathematics : Tests basic operations with whole numbers, 

some with fractions; a few items testing simple concepts; 
measurement items; a few one-step problems* Items are at 
Grade 6 level or less. 

45 items. No time limit, but Intended for use in one 
class period. 

2. Filing : Intended to test ability to alphabetize and file correctly. 

Item format: file of five names, one name to be filed. 

Each file used for two items, to minimize reading. Most 
names are common names of one or two syllables. 

Variations in order of last and first names, and in 
positions of differentiated letters within last names. 

24 items. Time allowed: 6 minutes. 

3. Object Drawing : Intended to measure eye-hand co-ordination. Items require 

students to draw a specified object through given dots, to 
trace over a given line, or to draw a line between given lines. 
Several items contain shapes to be copied. Scoring requires an 
overlay of tolerance regions, and a list of criteria to be 
followed. 

27 items* Time allowed: 5 minutes. 

4. Vocational Interest Inventory : (adapted with permission from Freeberg, 1969) 

Item format: pictorial illustration of typical job task, 

accompanied by simple description of task. Drawings and 
lettering clear and dark. Items to be rated on 4-point 
scale, ranging from "Pretty bad - I couldn't take doing it" 
to "This is great - just the kind of thing I would like 
to do". 

Separate forms for boys and girls. Four scale scores provided 

for each sex (the scales were generated from factor analyses 
of item responses in Sample 1) 
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The scales are : 

White Collar /Clerical 
Blue Collar/Aesthetic & Technical 
Personal Service /Personal Service 
Outdoor/Low Level Occupations (incl. Outdoor) 

Boys: 30 items; Girls: 28 items. No time limit (ten 

minutes is generally sufficient) 

5. self Location of Traits: Intended as a self-report instrument for students 

to express their preferences for various tasks within the 
Data-People-Things hierarchies. Item format: simple 

description of job task, e.g. "Find numbers in one 
place and copy them in another". 

Students responded by marking on a three point scale whether 
or nc-t they would like to do each task on a job. 

26 items: time required, about 5 minutes. 

This instrument was considered to be experimental only, and 
since results from the analyses carried out did not support 
the hypothesized hierarchies, no meaningful scores could be 
derived from this instrument. It was therefore excluded 
from the battery. 

6. Preference Record Form: Intended to supply implicit selection information 

’ for use in correcting for range restriction (Linn, 1967). 

Listed all shop courses, asked students to rank in order the 
6 they would moat like to take, then in order the 6 they 
would least like to take. This was a complicated task for 
the students, as well as producing confounding with sex 
preferences in the "dislikes" section (due to faulty design 
of the instrument). This instrument was also excluded from 
the battery. 

Phases II and III . In terms of procedure, these two phases paralleled each other. 
In Phase II, the predictor battery was administered in September and October to 
the validation sample, make-up testing extended into November, and criterion 
data was collected for this sample at the end of the school year. In Phase III 
the same procdures were carried out the following year with the cross-validation 
sample, except that both sets of measures in this phase were restricted on the 
basis of analyses carried out in Phase II. A mishap occurred in that the Motor 
Ability scores for the CVS were discarded by-the school before we had been able 
to record them. Since this test requires individual administration, it was 
not practical to give the test again. 
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Mean scores and standard deviations on the predictor tests are shown for 
the two samples in Tables 3 and 4. In general these indicate the samples to be 
fairly comparable, though the CVS boys were significantly lower in Reading and 

Tables 3 and 4 about here 

Mathematics. Intercorrelations among the predictors are shown for the two 
samples in Tables 5 and 6. The overall pattern of inter correlations is very 
similar, with the one exception that the Mechanical Reasoning test correlated 
considerably higher with most other tests for boys in the CVS than it did in 
the VS. 

Tables 5 and 6 about here 

Ml tests were administered under standardized conditions. To compensate 
as much as possible for the generally low reading level of the students every 
effort was made to see that they understood test directions. The maximum number 
of students at any one session was about 80, and, for most sessions, one proctor 
for approximately every ten students was present. Directions for all tests 
were read aloud as the student? followed the relevant sections of their test 
papers. For the three Clerical Aptitude tests the procedure of including a 
complete practice page, called "Part I" of the test but not scored, was adopted, 
since it was felt in the pilot sessions that many students lost valuable testing 
time through not being sure of what they were required to do. All items in 
the SLOT Profile were read aloud while the students worked through them. 
Throughout all sessions both the attitude of the students and the general testing 
conditions were good. 

Most of the tests were scored by hand. For the Reading, IPAT Intelligence, 
DAT Mechanical Reasoning and Maths IXP tests the students used separate answer 
sheets. For ill other tests their responses were written directly on the test 
,■ booklets , following the findings by Clark (1968) that slow learners made 
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significantly more errors when using answer sheets than when writing answers 
on their test papers. In Phase II, responses from the Highland Park Mathematics 
test, the filing test, the Vocational Interest Inventory (VII), the Preference 
Record Form (PRF) and Self Location of Traits (SLOT) were key-punched and trans- 
ferred to tape for further analyses. 

Criterion data comprised marks in all six academic subjects and in all shop 
courses taken during the first year. All mark's were expressed as percentages. 

An over-all academic average was computed for each student. Since differential 
prediction cannot successfully be achieved for highly similar criteria, and 
since it was assumed that the 25 "different" shops would involve considerable 
overlap in the abilities and skills required to succeed in them, it was proposed 
that the shops should be clustered in Phase II so that similar shops would be 
considered together. Initial plana for establishing shop clusters by multiple 
discriminant analysis had to be abandoned. A requirement of MDA is that the 
categorization of subjects must be unique, therefore "shop success' could not 
be used for categorization, since most students were successful in more than one 
shop. As an alternative, the selection of "favorite shop" was considered. 
However, most of the students were then distributed among the few most popular 
shops, leaving many shops with insufficient numbers for MDA to be legitimately 
carried out. It was therefore decided that intercorrelations among shop grades 
should be the major factor in determining the shop clusters, though this also 
was partly unsatisfactory because some pairs of shops had only small numbers of 
students taking both. The full list of shops available at the school, and the 
allocation of these shops to clusters, are shown in Tables 7 and 8. Generally 
speaking the clusters are in accordance with common ideas about the nature of the 

Tables 7 and 8 about here 

shops themselves. For each student an average grade per cluster was computed. 




11 



Since most students took at least one shop from each duster, the problems of 
range restriction and bias due to self-selection (e.g. see Wesman and Bennett, 1951) 

were not a serious issue in this study. 

The number of students in each sample with scores in each criterion cluster 
is shown separately by sex in Table 9. In Tables 10 and;.ll the intercorrelations 
between pairs of criteria are shown. Many of the correlation coefficients are 
moderately high, despite the attempts to differentiate shop areas by means of 
clustering. 

Tables 9, 10 and 11 about here 

In the validation phase scores derived from rating scales of satisfaction 
with shop courses were also analyzed. Item intercorrelations showed that 
motivator/hygiene dimensions of satisfaction ^ et al ioul5 9 not meaningfully 

be distinguished for this sample of students. Satisfaction scores used as 
criteria were a simple 5— point rating of over— all satisfaction, and motivator/ 
hygiene ratings added together. For each student an average satisfaction per 
cluster was computed, based on his ratings of the shops that he took. 

In the validation sample complete predictor data was obtained for 192 
boys and 95 girls (if he missed only one test a student was considered to have 
a complete record). Criterion data was collected for 172 of these boys and 
86 of the girls. In the cross-validation sample, complete predictor data (on 
a reduced battery) was obtained for 202 boys and 140 girls, and criterion data 
was collected for 171 of these boys and 120 of the girls. The reader is 
referred again to Figure 1 for a diagram showing the composition of the samples. 
Phase IV . The procedures followed in this double cross-validation stage involved 
statistical analyses only. These will be discussed in the next section. 
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A. Results 

Intercorrelation matrices for all predictors and criteria were computed 
separately by sex. Validities for the satisfaction measures were mostly low 
and somewhat random in nature, and so further analyses were restricted to the 
academic average and the four shop averages. Table 12 shows a complete list 
of all predictors and criteria that were considered in the validation phase. 
Intercorrelations between the restricted predictor and criterion lists are 
shown for boys in both samples in Table 13, and for girls in both samples in 
Table 14. In general, the patterns of correlation coefficients are similar. 

Tables 12, 13 and 1A about here 

In Phase II, stepwise regression analyses were done separately by sex 
for each criterion in turn, adding tests from the pool of predictors as long 
as R 2 Increased by at least .01. The resulting combinations of predictor tests, 
standardized regression weights and multiple R's are presented in Table 15 
for boys and Table 16 for girls. 

Tables 15 and 16 about here 

The single most useful test for this sample was the Highland Park Mathematics 
test, which had large weights for academic averages for both sexes, and moderate 
weights for several shop averages. Some of the clerical tests and the interest 
scales were also useful, as was the specially developed "Object Drawing" test. 

In general, the girls' results were slightly more predictable than the boys'. 

The highest value of R obtained was 0.75, for girls' academic average, and the 

lowest was 0.32, for girls' shop miscellaneous. 

In order that Phase IV, the double cross-validation stage, could be carried 
out, the absolute validities for Sample 1 were re-computed, considering only 
scores on the restricted battery of predictor tests taken by both Sample 1 and 
2 ( 2 ). Yh e resulting beta weights and multiple R's for the boys and girls 

2 The Object Drawing test was also omitted, since several items were modified 
and the scoring system was changed to yield greater variance. 
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in Sample 1 are shown in Tables 17 and 18. It can be seen that some reduction 

Tables 17 and 18 about here 

occurred in all of the R' s , though this was generally only slight. These tables 
also show the results of the cross-validation phase , when the Sample 1 weights 
were used to predict the criterion scores for the sample 2 students. Tables 19 
and 20 show the double cross-validated Rls, when 88tfl of wci 8 hts "*re derived in 
Sample 2 and then applied back to Sample 1. The over-all absolute validity 
results can best be seen from the summary shown in Table 20a. With one or two 

Tables 19, 20 and 20a about here 

exceptions, notably shops cluster B for boys, the cross-validated and double 

cross-validated multiple correlations held up very well. All are high enough to 

be of at least marginal value for absolute prediction, and several are much 

higher. Once the regression equations for each criterion for each sex, based 

on the selected predictor tests shown in Tables 17 to 20, had been set up, 

two scores were predicted for each criterion for each student in both samples 

(one from the weights derived in his own sample, the other from the weights 

derived in the other sample). Two sets of intercorrelations for each sex in 

each 8 ample were then computed among pairs of predicted criteria (the terms 

in Mollenkopf’s equation). These are shown in Table 21 for boys, and in Table 

22 for girls. ^For completeness, the actual criterion in ter correlations 

(r . terms) are also shown in these tables (see also Tables 10 and 11). 
ab _________________ 

Tables 21 and 22 about here 

The predicted criterion intercorrelations are very consistent for the two 
samples when the same set of weights is used, and show some consistency across 
sets of weights. Many of the values are quite high, a usual, though undesirable, 
finding in differential prediction studies (Norris and Katz, 1970). 
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Finally, two seta of differential validity coefficients were computed for 
each sex in each sample, using the two sets of r^* values and the two sets of 
absolute validities in Mollenkopf’s equation. These results are shown in 
Table 23 for beys and in Table 24 for girls. Again, the results are very 

Tables 23 and 24 about here 

consistent for the two samples when the same set of weights is applied, and 
show similarities across sets of weights. The differential correlations 
computed with Sample 1 weights are generally higher than those computed with 
Sample 2 weights, and appear to show that differences in criterion performance 
are more predictable for girls than for boys. Differential correlations com- 
puted from Sample 2 weights, however, show no clear superiority in results 
for either sex. It is a familiar finding in absolute prediction studies that 
girls are more predictable than boys, but so far evidence in differential pre- 
diction studies is conflicting. For example, Norris and Kata (1970) found 
differential prediction of course marks to be better for girls than for boys in 

Grade 13, but better for boys than girls in Grade 12. 

Despite the relatively high values of r a * b * (shown in Tables 21 and 22) and 

the moderately high r^ values in Sample 2, most of the cross-validated and 

double cross-validated differential correlations are at least as good as, or 

slightly better than, values reported in other studies. The tendency for r flb 

and r * values to vary together is shown in Figure 3, which was plotted from 
a*b* 

the set of results computed for Sample 1 using the regression weights shown 
in Tables 15 and 16. The scatter plot in Figure 4 shows that the governing factor 
in the magnitude of the differential validities may not be the values of * a * b * 
and r . as such, but rather the proximity of each r^* to the r ab between the 

HD 

same pair of criteria. A plot of the same two quantities, using data from p 40 

Figures 3 and 4 about here 

and p 44 of their report, from Norris and Katz' study shows a similar relationship. 
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This seems to Indicate that accuracy In the prediction of criterion scores is 
as important to successful differential prediction as having criteria which 
can be differentiated. 

In practical terms* considering the differential validities shown in 
Tables 23 and 24, it appears that differences in academic performance and 
performance in shop areas can be predicted with some success for both sexes. 

Among the shop areas for girls. Typing (shops A) can be differentiated moderately 
well from all other clusters, and Personal Grooming (shops B) can be different- 
iated from Domestic tasks (shops C) . For boys it appears that differences 
between performance in pairs of shop clusters cannot be predicted very well, 
with the possible exception of Mechanical tasks (shops A) compared with both 
Construction tasks (shops C) and W scellaneous (shops D)« According to French 
(1964), differential validities should be assessed in the same way as absolute 
validities, but bearing in mind that differential prediction is more difficult. 
Thus, even differential correlations in the .30's may lead to statements of 
students' relative chances of success in different areas which could be of some 
use in guidance. 
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Mollenkopf *s Formula for Differential Va lidities. 



One of the more frequently used formulae for expressing differential 
etlldlty Is due to Mollenkopf (1950), and was the one used In the present study, 
com the formula the validity of a battery in predicting a difference between two 
riteria, a and b, can be found. If d is the observed difference between perform- 
nee on the two criteria (d - a - b) and d* is the difference between predicted 
erformance on the snme criteria (d* ■ a* ■ b*) , then the validity of the predicted 
ifference is obtained from the formula; 



R d*d 



ml R a*a + ®b*b " 2R a*» Vb r a*b* 
V 2(1 - r .b> 



Va or Vb 18 



r a*b* 

r ab 



is 

is 



the validity of the battery for predicting criterion a or b 
the correlation between predicted criteria 
the correlation between actual criteria. 
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HIGHLAND PARK DIFFERENTIAL VALIDITIES STUDY: VALIDATION AND CROSS VALIDATION OF PREDICTOR BATTERY 
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Figure 2 • Distribution by sample of reading levels, as measured by Nelson 

Reading Test, Form A. 
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Table 1 



Predictor Tests Used With Validation Sample 




Content Area 



Test 



SCHOLASTIC APTITUDE 

VERBAL APTITUDE 
MATHEMATICAL APTITUDE 

CLERICAL APTITUDE 

MECHANICAL APTITUDE 
MANUAL DEXTERITY 
VOCATIONAL INTERESTS 
OCCUPATIONAL PREFERENCES 

MOTOR ABILITY 



I, P. A. T. "Culture Fair" Intelligence 
Form A. 

Nelson Reading, Form A. 

Maths IXF (Ottawa Board of Education) 
Highland Park Mathematics* 

Number Comparisons (Personnel 

Name Comparisons (Research Institute) 

Filing* 

Mechanical Reasoning (D. A. T) 

Object Drawing* 

Vocational Interest Inventory* 

Self Location of Traits Profile* 
Preference Record Form* 

Western Motor Ability - Boys only 
(University of Western Ontario) 



* Instruments developed specifically for this study. 



Reliability Indices 



Maths IXF 
Highland Pk. Math 
Filing 



VII Scales 

Clerical 

Service 

Outdoor 

Technical 



: 0.93 (K-R 20) 

: 0.91 (K-R 20) 

: 0.88 (K-R 20 on first thirteen items, stepped up by 
Spearman-Brown formula for a test of 24 items- 
gives an estimate of the reliability if the whole 
test had been done under power condi tiPns) 

Boys Girls 

0.74 0. 79 (OC coefficients) 

0.73 0.67 

0.68 0.78 

0.81 0.77 



O 
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Table 2 



Published tests tried In pilot stages of the study, and reasons for their exluslon 

from the predictor battery 



Area 



Test 



Reason for exclusion 



Scholastic 

Aptitude 


Henmon-Nelson 

(Houghton , -Mifflin) 


Too verbal for use with group with 
low reading skills. 


Verbal 

Aptitude 


Gates -MacGln 1 1 ie 
(Teachers College 
Columbia Press) 


Yielded similar results to the 
Nelson test, but not as easy to 
administer and score. 


Mathematical 

Aptitude 


Metro. Achievement 
Arlth-Advanced 
Metro. Achievement 
Arith-Intermediate 
(Her court Brace) 


Much too difficult 

Rather difficult. Too long for 
students with short attention span 


Clerical 

Aptitude 


Short Tests of Clerical 
Ability (S. R. A.) 
Language 

Arlth, Parts I & II 
Checking and Coding 


Too difficult 
Too difficult 

Could have been used; were excluded 
because of overlap with the 
selected tests In this area. 


Manual 

Dexterity 


Object Completion 

(Psychometric Affiliates) 

Purdue Pegboard (S. R. A.) 


Rather easy; seemed more related to 
spatial perception than motor 
co-ordination 

Impractical, because it requires 
individual administration. Would 
be valuable In situations where 
fj,.ne eye-hand coordination is 
important. 


Vocational 

Interests 


Geist Picture Interest 
Inventory (Western Psych. 
Services) 

Minnesota Voc. Int. Inv. 
(Psych. Corporation) 


The relatively detailed, fine line 
drawings were confusing to many 
of the students. 

Much too long, vocabulary level 
much too high 


Occupational 

Preferences 


Gordon Occupational 
Checklist (Hat court Brace) 


Too long and difficult. Too much 
of its content beyond the realm 
of the students' experiences 



Table 3 



Mean Score and Standard Deviation by Sex on Predictor Tests 

Sample 1 (Validation) 

Total number of boys In sample ■ 192 
Total number of girls in sample * 95 

BOYS GIRLS 



Xest N Mean S. D» N Mean S« D. 



Highland Fk. Math. 


186 


26.1 


8.2 


92 


20.8 


8.5 


Filing 


191 


8.8 


5.4 


94 


7.8 


5.6 


Number Comparisons 


192 


29.2 


8.1 


95 


30.3 


9.3 


Name Comparisons 


186 


27.3 


9.6 


95 


28.7 


12.2 


Object Drawing 


187 


13.9 


5.9 


93 


13.8 


6.2 


f Clerical 


188 


21.7 


6.1 


93 


19.2 


4.5 


1 Service 


188 


11.6 


3.4 


93 


17.7 


3.9 


VII < 

1 Outdoor 


188 


8.0 


3.1 


93 


13.0 


3.8 


y Technical 


188 


20.8 


6.4 


93 


15.2 


7.5 


DAT Mech. Reas. 


187 


36.8 


8.5 


92 


29.6 


6.3 


Reading (raw score) 


192 


72.8* 


22.2 


95 


68.1* 


20.8 


I.P.A.T. Intelligence 


190 


2 A. 8** 


6.4 


92 


22.4** 


7.0 


(raw 8 core) 
Math IXF< a > 


171 


11.6 


4.2 


86 


9.7 


4.1 


Motor Ability ^) 


159 


46. 5 


14.8 









* Equivalent to grade levels of 5*9 and 5.7 for boys and girls respectively 

** Equivalent to IQ's of 87 and 83 for boys and girls respectivexy 

(a) & (b) No make-up testing of absentees on these tests was attempted, hence the 

lower N* 8 

(b) Not administered to girls 



Table 4 



Mean Score and Standard J i aviation by Sex on Predictor Tests 



Sample 2 (Cross-Validation) 

Total number of boys In sample ■ 202 
Total number of girls in sample ■ 140 



BOYS GIRLS 



Test 


N 


Mean 


S.D. 


N 


Mean 


S.D. 


Highland Fk. Math. 


191 


21.8 


8.9 


134 


18.0 


7.7 


Filing 




198 


10.4 


4.6 


138 


10.5 


5.4 


Number Comparisons 


200 


31.9 


8.4 


134 


33.6 


9.3 


Name Comparisons 


200 


27.8 


8.2 


136 


29.1 


8.1 


Object Drawing 


199 


28.5 


7.6 


132 


26.6 


8.0 




/Clerical 


193 


19.6 


5.9 


132 


17.5 


5.1 


VII < 


' Service 


193 


11.5 


3.4 


132 


17.3 


6.4 




Outdoor 


191 


8.0 


3.3 


132 


12.1 


3.9 




^Technical 


191 


20.8 


5.2 


132 


14.1 


4.6 


DAT Mech . Reas . 


174 


36.4 


9.0 








Reading 


(raw score) 


197 


62.2* * 


23.4 


137 


63.0* 


22.7 


I.P.A.T 


. Intelligence 














(raw 8 core) 


180 


24.2** 


5.7 


132 


21.5** 


5.8 



(a) Not administered to girls 

* Equivalent to grade levels of 5.4 and 5.5 for boys and girls respectively 

** Equivalent to IQ's of 86 and 82 for boys and girls respectively 



Intercorrelations of Predictor Tests - VALIDATION SAMPLE 




O 

ERLC 



(0 




Fk 

X 



X 



CD 






5 3 



•§> 

•H 

aa 



CO 




m 


vO 




00 


o> 


o 


iH 


CM 


Cl 












iH 


H 


iH 


rH 


rH 


to 


• 






X 


H 


4) 


M 


iH 

0 

O 

-i 




60 


• 


0 


0 

04 


• 

u 


oto 

0)0 


4J 

•H 


0 

O 


U 

r? 


O 

o 




£ 


O' 


H 


I 




SB 


rH 

•H 




C 


T3 

4J 


•n 

0 


§ 


1 


• 

M 


pH 






on 

h 


£ 




<u 

CO 


5 


•s 

A) 


p 


1 





n 

a) 



M 

O 



i. 






0 

w 



a> 

co 

a) 



2 S 




A 



S5 



8 for males above diagonal; recults for females below diagonal. 

correlation coefficients are not significantly different from zero at the .05 level. 



Intercorrelations of Predictor Tests - CROSS-VALIDATION SAMPLE 
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Table 7. 



Shop courses available at the school* 



Art 

Auto Body 
Auto Service 
Carpentry 
Drafting 

Industrial Sewing 
Dry Cleaning 
Electrical Repair 
Food Services 
Graphic Arts (Printing) 

Home Management 
Horticulture 
Hospital Care 
Machine Shop 
Music 

Painting and Decorating 

Personal Grooming (Hair Dressing) 

Retailing 

Sheet Metal 

Small Engines 

Trowel Trades 

Typing and Office Practice 

Upholstery 

Welding 



Shops for boys only : 



For girls only : 



For boys and girls ; 



Auto Body 
Auto Service 
Building Maintenance 
Carpentry & Mlllwork 
Drafting 

Electrical Repair 
Machine Shop 
Sheet Metal 
Small Engines 
Trowel Trades 
Welding 




Home Management 
Personal Grooming 



30 



Art 

Dry Cleaning 
Food Services 
Graphic Arts 
Horticulture 
Hospital Care 
Industrial Sewing 
Instrumental Music 
Painting & Decorating 
Retailing 

Typing & Office Practice 
Upholstering 



Table 8 



Allocation of Shops to Clusters 



Cluster 


BOYS 

Shop 


Cluster 


GIRLS 

Shop 


A 


Auto Body 
Auto Service 
Electrical Repair 


A 


Typing & Office 
Practice 




Graphic Arts 
Machine Shop 


B 


Personal Grooming 




Small Engines 


C 


Dry Cleaning 
Food Services 


B 


Art 

Drafting 

Instrumental Music 




Home Management 
Industrial Sewing 




Painting and Decorating 

Retailing 

Upholstering 


D 


Art 

Graphic Arts 
Horticulture 
Hospital Care 


C 

D 


Carpentry and Mlllwork 
Sheet Metal 
Trowel Trades 
Welding 

Building Maintenance 
Dry Cleaning 
Food Services 
Horticulture 
Hospital Care 
Industrial Sewing 
Typing & Office 
Practice 




Instrumental Music 
Painting and Decorating 
Retailing 
Upholstering 



Table 9 



Frequency of Students by Criterion, Sample and Sex 



Number of students with scores 

Validation Sample Cross-Validation Sample 

Criterion Boys Girls Boys Girls 



Academic grade average 


168 


85 


169 


119 


Shop grade average 
- Cluster A 


148 


74 


155 


103 


- Cluster B 


140 


66 


135 


48 


- Cluster C 


140 


75 


128 


111 


- Cluster D 


97 


82 


95 


118 




32 



Table 10 



Intercorrelations of Selected Criteria - BOYS 
(Sample sizes in parentheses) 



I. Validation Sample 



Academic 

average 




II » Cross-Validation Sample 



Academic 

average 
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Table 11 



Intercorrelations of Selected Criteria - GIRLS 
(Sample sizes In parentheses) " 



I. Validation Sample 




II. Crosa-Valldatlon Sample 

Academic 





34 



Table 12 



Complete List of Predictor and Criterion Variables used with Validation Sample 



Predictors 

1. Mathematics IXF 

2. Highland Park Mathematics 

3. Piling 

4. Number Comparisons 

5. Name Comparisons 

6. Object Drawing 

7. Motor Ability (boys only) 

Vocational Interest Inventory (VII) 

8. White Collar - Boys; 

9. Service - Boys; 

10. Outdoor - Boys; 

11. Blue Collar - Boys; 

12. DAT Mechanical Reasoning 

13. Reading 

14 . IQ (non-verbal) 

15. Preference Record Form (PRF) 

16. Preference Record Form (PRF) 

17. Preference Record Form (PRF) 

18. Preference Record Form (PRF) 

Criteria 

1. Academic grade average 

2. Shop grade average, Cluster A 

3. Shop grade overage, Cluster B 

4. Shop grade average, Cluster C 

5. Shop grade average, Cluster D 

6. Overall satisfaction (Item 9 only) 

7. Total satisfaction (sum of items 1 to 9) 

8. Motivator/hygiene satisfaction (sum of items 1 to 8) 

9. Shop satisfaction average. Cluster A 

10. Shop satisfaction average. Cluster B 

11. Shop satisfaction average. Cluster C 

12. Shop satisfaction average. Cluster D 



Clerical - Girls 

Service - Girls 

Low Level Occupations - Girls 

Aesthetlc/Techdlcal - Girls 



Average for Shop Cluster A 

Average for Shop Cluster B 

Average for Shop Cluster C 

Average for Shop Cluster D 




^5 







H 
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Intercorrelations of Predictors with Selected Criteria - GIRLS 

(Sample sizes in parentheses) 







Table 15 



Standardized Regression Weights and 
Multiple Correlatlona (Bovb) * 



Validation Sample, Complete Predictor Battery 





Criterion 


Predictors 


Standardized 
Regression Weights 


Multiple 

Correlation 



Academic 


H. Pk. Math 


.5964 


.6417 


Grade Average 


Object Drawing 


.2008 






VII - White Collar 


.1497 






Reading 


-.1541 




Shop Grades, 


DAT - MR 


.1488 


.4935 


Cluster A 


Filing 


.1811 






Motor Ability 


.1830 






Object Drawing 


.1768 






IQ 


.1203 




Shop Grades, 


H. Pk. Math 


.2307 


.3826 


Cluster B 


Object Drawing 


.1803 






Reading 


-.1965 






Number Comparisons 


.1774 






VII - White Collar 


.1219 




Shop Grades, 


H. Pk. Math 


.3117 


.3976 


Cluster C 


Object Drawing 


.1850 






Reading 


-.1818 






Motor Ability 


.1017 






VII - Outdoor 


.1587 






VII - Service 


-.1194 




Shop Grades, 


Maths IXF 


.2144 


.3993 


Cluster D 


Number Comparisons 


.2211 






VII - White Collar 

a. 


.1961 




* Variables 


added to regression equation 


as long as Increment 


to squared multiple R 



was at least .01. 
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Table 16 



Standardised Regression Weights and 
Multiple Correlations (Girls) * 



Validation Sample, Complete Predictor Battery 



Criterion- 



Predictors 



Standardised 
Regression Weights 



Multiple 
Correlation 



Academic 
Grade Average 



Shop Grades, 
Cluster A 



Shop Grades, 
Cluster B 



Shop Grades, 
Cluster C 



Shop Grades, 
Cluster D 



H. Pk. Math 


.6332 


Maths IXF 


.1716 


Name Comparisons 


.1912 


Reading 


-.1461 


VII - t each. /Tech. 


.1122 


Name Comparisons 


.3227 


VII - Aesth./Tech. 


-.2580 


Number Comparisons 


.2527 


Maths IXF 


.2196 


VII - Clerical 


-.1494 


H. Pk. Math 


-.1789 


H. Pk, Math 


.3241 


Object Drawing 


.2498 


VII - Aesth./Tech. 


.1637 


DAT - MR 


.1496 


VII - Service 


-.1146 


IQ 


-.1377 


H. Pk. Math 


.4534 


Maths IXF 


.2019 


VII - Low Level Occupations 


.1174 


H. Pk, Math 


.1861 


VII - Service 


-.1774 


VII - Low Level Occupations 


.1470 


IQ 


.1452 



.7484 



.6420 



.4471 



.5498 

.3249 



* Variables added to regression equation as long as Increment to squared multiple R 
was at least .01. 



Table 17 



Predictor Batttery - BOYS 
Sample 1 (Validation Sample) 


Criterion 


Predictors 


3 


R** 


Sample 1 weights 
applied to Sample 2 


Academic 


B. Pk. Math 


.6312 


. 61 (. 64 ) 


R ■ .54 


average 


Vll-White Collar 


.1282 








Reading 


-11293 






Shop grades, 


DAT-MR 


.2666 


.41 (.49) 


R ■ .44 


Cluster A 


Filing 


.2295 








VII-Blue Collar 


.1062 






Shop grades. 


H. Pk. Math 


.2737 


•33(.38) 


R - .28 


Cluster B 


Number Comp 


.1859 








Reading 


-.1751 






Shop grades. 


H. Pk. Math 


.2851 


. 32 (. 40) 


R - .32 


Cluster C 


Reading 


-.1682 








DAT-MR 


.1315 






Shop grades. 


Number Comp 


.2276 


.36(.40) 


R - .26 


Cluster D 


Vll-Whlte Collar 


.2014 








H. Pk. Math 


.1134 







* Stepwise analyses were limited to three steps, since previous analyses 
showed little Improvement In prediction when more than three variables 
were used. 

** Values shown In brackets are those derived from the full predictor battery. 
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Table 18 



Standardized Regression Weights (8) and Multiple Correlations* for Restricted 



Predictor Battery - BOYS 
Sample 2 (Cross-Validation Sample) 






A 




Sample 2 weights 


Criterion 


Predictors 


0 


R 


applied to Sample 1 


Academic 


H. Pk. Math 


.4104 


.64 


R - .51 


average 


Reading 


.2142 








DAT-MR 


.1249 






Shop grades. 


DAT-MR 


.3326 


.46 


R - .39 


Cluster A 


Filing 


.1600 








Name Comp 


.0593 






Shop grades, 


DAT-MR 


.3256 


.46 


1 

• 

00 


Cluster B 


VH-White Collar 


.1489 








H. Pk. Math 


.1714 






Shop grades , 


H. Pk. Math 


.2436 


.37 


R - .25 


Cluster C 


Number Comp 


.1884 








Vll-White Collar 


.1516 






Shop grades. 


Number Comp 


.1857 


.32 


R - .23 


Cluster D 


Vll-Service 


.1613 








DAT-MR 


.1614 







* Stepwise analyses were limited to three steps, since previous analyses 
showed little improvement in prediction when more than three variables 
were used. 




* 
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Table 19 

Standardized Regres iipr. Weights (8) and Multiple Corre la tions* for Restricted 



Preulctor Battery • GIRLS 





Sample 1 (Validation 


pie) 




Criterion 


Predictors 


B 


R** 


Sample 1 weights 
Applied to Sample 2 


Academic 


H. Pk. Math 


.6641 


.73 (.75) 


R - .66 


average 


Name Comp 


.1599 








V II-A/T 


.1168 






Shop grades, 


Name Comp 


.2968 


,60(.64) 


R - .35 


Cluster A 


VII-A/T 


-.2364 








Number Comp 


.2622 






Shop grades, 


H. Pk. Math 


.3670 


,37(,45) 


R - .45 


Cluster B 


VII-A/T 


.2080 








VI I -Service 


-.1261 






Shop grades, 


H. Pk. Math 


.5395 


,53(.55) 


5*3 

■ 

• 

** 

O 


Cluster C 


VII-LE 


.1018 








Vll-Service 


-.0809 






Shop grades, 


H. Pk. Math 


.2696 


.30(. 32) 


R - .39 


Cluster D 


Vll-Service 


- .1760 








VII-LL 


.1291 







* Stepwise analyses were limited to three steps, since previous analyses 
showed little improvement In prediction when more than three variables 
were used. 



** Values shown in brackets are those derived from the full predictor battery. 
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Table 20 



Standardized Regression Weights (B) and Multiple Correlations* for Restricted 



Predictor Battery - GIRLS 
Sample 2 (Cross-Validation Sample) 










Sample 2 weights 


Criterion 


Predictors 


0 


R 


applied to Sample 1 


Academic 


H. Pk. Math 


.4806 


.69 


R - .66 


average 


Reading 


.2099 








Filing 


.0915 






Shop grades. 


Reading 


.2125 


.47 


R - .46 


Cluster A 


Name Comp 


.2047 








Filing 


.1446 






Shop grades. 


H. Pk. Math 


.4468 


.50 


R - .28 


Cluster B 


VII-A/T 


.2104 








VII-LL 


.1652 






Shop grades. 


Reading 


.3018 


.50 


R - .42 


Cluster C 


H. Pk. Math 


.2314 








Vll-Service 


-.1227 






Shop grades. 


Reading 


.3167 


.54 


R - .22 


Cluster D 


Name Comp. 


.1592 








H. Pk. Math 


.1539 







* Stepwise analyses were limited to three steps , since previous analyses 
showed little improvement in prediction when more than three variables 
were used. 
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Table 20a 

Comparison of Multiple R*s In Cross-Validation 
and Double Cross-Validation 



Summary of Tables 17 to 20 



Criterion 


C - 
(l.D* 


BOYS* 

V DC 

.(1.2) (2,2) 


- V 
(2.1) 


C - 
(1.1) 


GIRL 

V 

(1,2) __ 


S b 

D C 
(2,2) 


- V 

(2.D 


Academic 

average 


.61 


.54 


.64 


.51 


.73 


.66 


.69 


.66 


Shopo A 
average 


.41 


.44 


.46 


.39 


.60 


.35 


.47 


.46 


Shops B 
average 


.33 


.28 


.46 


.18 


.37 


.45 


.50 


.28 


Shops C 
average 


.32 


.32 


.37 


.25 


.53 


.40 


.50 


.42 


Shops D 
average 


.36 


.26 


.32 


.23 


.30 


.39 


.54 


.22 



* Indicates Sample 1 weights used In Sample 1, etc* 
a The number of boys In each sample was approximately 200. 
b The number of girls in each sample was approximately 100. 
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Table 21 

Intercorrelatlons of Predicted and Actual Criteria - BOYS 
Sample 1 (Validation) and Sample 2 (Cross-Validation) 

I, Correlations between Predicted Criterion Scores (r a *b* terms) 

(a) Using Sample 1 weights (Sample 1 below diagonal. Sample 2 above diagonal) 







1 


2 


3 


4 


5 


1. 


Acad. av. 




.53 


.76 


.90 


.59 


2. 


Shops A 


.54 s " 




.39 


.63 


.43 


3. 


Shops B 


.81 


.46^ 


S s -- N \ 


.79 


.69 


4. 


Shops C 


.83 


.65 


,80 s 




.43 


5. 


Shops D 


.67 


.45 


.71 


.39^ 


s. ” 



(b) Using Sample 2 weights (Sample 1 below diagonal. Sample 2 above diagonal) 

1 2 3 4 5 

1. Acad. av. 

2 . Shops A 

3. Shops B 

4 . Shops C 

5. Shops D 

II. Correlati ons between Actual Criterion Scores. (r a b terms) 

(Sample 1 below diagonal. Sample 2 above diagonal) 

1 2 3 4 5 

1. Acad. av. 

2 . Shops A 

3. Shops B 

4 . Shops C 

5. Shops D 



ERIC 





Table 22 



Intercorrelatlons of Predicted and Actual Criteria - GIRLS 
Sample 1 (Validation) and Sample 2 (Cross-Validation) 



I, Correlations between Predicted Criterion Scores (r a *b* terms) 

(a) Using Sample 1 weights (Semple lbelor diagonal, Sample 2 above diagonal) 

1 2 3 A 5 

1* Acad. Av. 

2. Shops A 

3. Shops B 

4 . Shops C 

5. Shops D 




(b) Using Sample 2 weights (Sample 1 below diagonal, Sample 2 above diagonal) 

1 2 3 A 5 



1. Acad. Av. 



2 . 

3. 

A. 

5. 



Shops A 
Shops B 
Shops C 
Shops D 




II. Correlations between Actual Criterion Scores (r*b terms) 
(Sample 1 below diagonal, Sample 2 above diagonal) 



1 



1. Acad. Av. 

2 . Shops A 

3. Shops B 
A . Shops C 
5 . Shops 0 




.9 



A 




A Girls 
• Boys 



.1 



-.1 0 .1 .2 .3 .4 .5 .6 .7 .8 .9 

r 0 b 

FIG. 3: RELATIONSHIP BETWEEN fob 
AND r<j*b* 




IN fob* AND Tab AND DIFFERENTIAL 
VALIDITY 
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Table 23 



Differential Validities (Rd»d) - BOYS 
Sample 1 (Validation) and Sample 2 (Cross-Validation) 



(a) Using Sample 1 weights (Sample 1 below diagonal, Sample 2 above) 



1. Acad. av. 

2 . Shops A 

3 . Shops B 

4 . Shops C 

5 . Shops D 

(b) Using Sample 2 weights (Sample 1 below diagonal, Sample 2 above) 

1 2 3 4 5 

1. Acad. av. 

2 . Shops A 

3 . Shops B 

4 . Shops C 

5 . Shops D 
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Table 24 

Differential Validities (Rd»d) - GIRLS 
Sample 1 (Validation!) and Sample 2 (Cross-Validation) 



(a) Using Sample 1 weights (Sample 1 below diagonal, Sample 2 above) 

1. Acad. av. 

2 . Shops A 

3. Shops B 

4. Shops C 

5. Shops D 




(b) Using Sample 2 weights (Sample 1 below diagonal. Sample 2 above) 



1. Acad. av. 

2 . Shops A 

3. Shops B 

4. Shops C 

5. Shops D 
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